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Background and Purpose Smartphone applications have been increasingly identified as a 
novel platform for dissemination of healthcare related information. However, there have 
been no studies done to evaluate the availability and content of stroke related apps. Pur- 
pose: This study aims to identify and analyze stroke-related applications available on the 
Apple iTunes and Android Google Play Store. 

Methods The Apple iTunes store and Android Google Play Store were searched for stroke- 
related applications on July 27, 2013 using keywords: stroke, brain attack, intracranial hem- 
orrhage, subarachnoid hemorrhage, cerebral infarction. The content of the applications was 
analyzed by two independent investigators. 

Results A total of 93 relevant applications (46.2% android and 53.8% iPhone) were identi- 
fied of which 47.3% were available free of cost. 92% of apps were identified as useful by 
users and over 60% had scientifically valid information. There is a significant participation 
of healthcare agencies in dissemination of stroke related information through apps with 
47.3% apps being uploaded by them. Over half of all stroke related apps were aimed to- 
wards health care workers (51.6%), 75% of which could be utilized as bedside tools for pa- 
tient care and remainder had information related to recent research advances. The differ- 
ence in scientific validity between the apps aimed at general population versus healthcare 
professionals was statistically significant (P<0.01). There was no statistical association be- 
tween cost of app and scientific validity or usefulness. 

Conclusions Smartphone apps are a significant source of information related to stroke. An 
increasing participation of healthcare agencies should be encouraged to promote dissemi- 
nation of scientifically valid information. 
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Introduction an< ^ has °P ene d up an entirely new era of health communica- 

tion. As of 2013, more than 50 billion and 48 billion apps have 
The ability of smart phones to deliver directed health infer- been downloaded from the Apple App Store and Android Play 
mation to the patients and healthcare providers is path breaking Store respectively by millions of smart phone users all over the 
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An increasing number of medical professionals are using 
smart phone applications for accessing clinical information on 
the internet and as clinical calculators. A prior study had esti- 
mated that the percentage of medical professionals using smart 
phones will rise to 66-90% by 20 12. 3 Increasing prevalence and 
popularity of smart phone apps among health- care profession- 
als complements the medical practice and has gained wide ac- 
ceptance as a training and information tool. 4,5 Smart phone 
apps are increasingly being used by the patients for information 
on early identification of stroke symptoms, risk factor aware- 
ness and management. 6,7 

Health-related smart phone apps are being actively studied 
for potential applications in a wide variety of fields of medical 
importance including but not limited to dermatology 8 ophthal- 
mology 9,10 and cancer. 11 Many studies have questioned the va- 
lidity and specificity of the health care information available on 
these subjects. 12,13 The quality of information disseminated in 
these apps would therefore play an important role in determin- 
ing the quality of health care provided. The primary aim of our 
study was to evaluate the stroke related apps available on Apple 
app store and the Android Play Store and to analyze the content 
and potential usefulness in the health care delivery system. 

Methods 

The Apple iTunes store and Android Google Play Store were 
searched for stroke-related applications on July 27, 2013. The 
search terms used to select the apps were: stroke, brain attack, 
intracranial hemorrhage, subarachnoid hemorrhage, cerebral 
infarction. The content of the applications was analyzed by two 
independent investigators (DD, AA). Each app was analyzed 
and classified on the basis of cost, target audience, type of infor- 
mation, validity, involvement of health-care agencies and useful- 
ness based on audience reviews and ratings. 

Costs 

Apps were categorized on the basis of fee/cost of download. 

1. Free: Apps which were downloaded free of cost. 

2. Paid: Apps which could be downloaded after making a 
payment. 

Target audience 

Apps were categorized based on the people for whom the 
apps were designed for. 

1. Health care workers: these apps included clinical informa- 
tion and recent advances targeted for health care workers to be 
used in the hospital/ clinic/ research laboratory. 
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2. General population: these apps were those which could be 
utilized by general population for education, primary or sec- 
ondary prevention and self management of their illnesses. 

Type of information 

Apps were divided on the basis of information provided. 

1. General information about the disease process: these in- 
cluded the apps providing information about etiology, patho- 
genesis and categorization of ischemic stroke, intracranial and 
subarachnoid hemorrhage. 

2. Recent research and advances: these apps provided infor- 
mation about latest research and advances in the field of vascu- 
lar neurology which have impacted the patient management. 

3. Tools to be used by health care professionals: these were 
various apps (e.g. NIHSS, ABCD 2 , CHA 2 DS 2 -VASc etc.) used 
by health care professionals for evaluation and management. 

4. Tools to be used by patients: these apps were utilized by 
the patients for maintaining medication compliance or manage- 
ment of risk factor(s) for stroke prevention. 

5. General awareness and support group apps: included in- 
formation about various awareness programs and support 
groups for patients and their relatives. 

6. Miscellaneous: this included relevant or irrelevant informa- 
tion on stroke which could not be categorized into any of the 
above categories. 

Uploading agencies 

Apps were divided into two groups based on the agency 
which sold or uploaded the app on Apple iTunes or Google 
Play Store. 

1. Health Care Agencies (HCAs): these included national or 
international medical/ surgical associations, medical universi- 
ties/medical schools, pharmaceutical companies, hospitals, re- 
search associations or medical journals. 

2. Non Health Care Agencies (Non HCAs) : private or gov- 
ernment agencies which do not belong to the above mentioned 
organizations. 

Scientific validity 

The scientific validity was based on the references provided 
by uploading agency/individual along with application. The 
apps which didn't have references, validity was decided based 
on whether or not the information or tool was compatible with 
updated stroke literature, expert reviews, national guidelines 
and recommendations by American Stroke Association. 

1. Scientifically validated apps: content of these apps was 
backed by scientific evidence. 

2. Non Validated apps: these apps did not contain scientific 
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evidence based information. 

Usefulness 

It was decided on the basis of audience reviews and ratings. 

1. Not useful: apps with poor ratings or comments (e.g. less 
than 2 stars). 

2. Moderately useful: apps which were rated as average by the 
users (e.g. 2-3 stars). 

3. Very useful: apps with good rating and reviews by the users 
(e.g. more than 3 stars). 

Statistical analysis 

Values are expressed as simple proportions. Univariable analy- 
sis was performed using Pearson's chi-squared test or Fisher's ex- 
act test for categorical variables. A 2-sided P value of < 0.05 was 
considered significant. Kappa coefficient of agreement between 
two investigators was calculated. All statistical analysis was done 
using IBM SPSS Statistics 19.0 for Windows (SPSS Inc.). 

Results 

A total of 107 apps were identified using the search terms. 
Fourteen apps didn't have information about stroke, therefore 
excluded from the study. A total of 93 relevant applications 
were analyzed. Forty three of these apps were uploaded on 
Google Play Store and fifty on Apple iTunes. Descriptive analy- 
sis of information collected in various categories was performed 
(Table l). 

Costs 

Out of the 93 apps, 47% (44) were available free of cost. 
More than half of these free apps (24) were considered very 
useful by the audience. Whereas 27 of 49 paid apps were con- 
sidered very useful as per user ratings. 61% (27) free apps and 
57% (28) paid apps had scientifically valid information. There 
was no statistical association between cost of app and scientific 
validity or usefulness. 55% (24) free apps and 49% (24) paid 



apps were targeted for health care professionals. 

Target audience 

Over half of all stroke related apps (48) were aimed towards 
health care workers and 45 were meant to be used by general 
public. 75% of apps aimed at health care workers could be uti- 
lized as bedside tools for patient care and remainder had infor- 
mation related to recent research advances. More than half 
(55%) of the apps for health care workers and 46% apps for 
general public were free of cost. Nearly 90% (43) apps for health 
care professionals were scientifically valid where as only 27% 
(12) targeting general population had the backing of scientific 
evidence. This difference was found to statistically significant 
(P<0.0l). 

Type of information 

Majority of apps provided tools to be used by HCAs (38.3%) 
and general public (35.5%). 4.3% apps provided general infor- 
mation about stroke etiology, pathogenesis and classification, 
where as 15.1% and 4.3% had information about recent ad- 
vances in stroke research and support groups respectively. Ma- 
jority (72%) tool applications for HCAs were considered very 
useful by the reviewers. 60% of tools for non-HCAs were con- 
sidered moderately useful as per the user ratings. 92% of tools 
for HCAs and only 20% tools for non HCAs tools were backed 
by scientific literature. There was statistically significant differ- 
ence between scientific validity of HCAs and non HCAs tool 
applications (P < 0.05). 

Uploading agency 

There was a significant participation of healthcare agencies in 
dissemination of stroke related information with 47.3% (44) 
apps being uploaded by them. Remaining 52.7% (49) apps 
were uploaded by Non HCAs. 66% (29) apps uploaded by 
HCAs were rated very useful and only 1 1% (5) considered non 
useful by the users. 70% (3l) and 49% (24) apps uploaded by 
HCAs and non HCAs were considered scientifically valid. The 



Table 1. Descriptive analysis of stroke related smart phone applications 

Type of General Research & Tools for health Tools for Support Miscellaneous Total 

information information advances care agencies (HCA) Non-HCA groups 

Total apps Number (%) 4(4.3) 14(15.1) 36(38.7) 33(35.5) 4(43) 2(2.2) 93(100) 

Scientifically valid information Yes 3 12 33 7 0 0 55 

No 1 2 3 26 4 2 38 

Usefulness (as per user ratings) Very 2 11 26 11 1 0 51 

Moderate 1 2 8 21 3 0 35 

Non-useful 11 2 10 2 7 

Costofapps Free 3 10 15 10 4 2 44 

Paid 1 4 21 23 0 0 49 
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Table 2. Outcome of descriptive analysis of stroke related smart phone apps 





Type of 
information 


Uploading agency 




Targeted audience 


Usefulness of apps (as per user ratings) 


Health care agency (HCA) Non-HCA 


HCA 


Non-HCA 


Very useful 


Moderately useful Non useful 


Total apps 


Number 


44 


49 


48 


45 


51 


35 9 


Scientifically valid information 


Yes 


31 


24 


43 


12 


42 


11 2 




No 


13 


25 


5 


33 


9 


24 5 


Cost of apps 


Free 


24 


20 


24 


20 


24 


15 5 




Paid 


20 


29 


24 


25 


27 


20 2 



difference in scientific validity between apps uploaded by 
HCAs and non HCAs was not statistically significant. 

Usefulness 

Majority (55%) of the apps were rated as very useful by users. 
38% were moderately useful and remaining (7%) non-useful. 
56% (27 very useful and 20 moderately useful) apps were paid 
apps. There was no significant difference between cost of the 
apps and usefulness. 

Scientific validity 

Majority of apps (59.1%) were scientifically valid. Most of 
these (78%) were aimed at healthcare professionals (Table 2). 
The difference in scientific validity between the apps aimed at 
general population versus healthcare professionals was statisti- 
cally significant (P< O.Ol). 96% (53) of the valid apps were 
considered useful (42 very useful and 1 1 moderately useful) by 
the users. Interestingly 87% (33) of non valid apps were also 
considered useful (9 very useful and 24 moderately useful) . 

Kappa Coefficient of agreement between the two investiga- 
tors (DD, AA) was 0.97. 

Discussion 

The world is seeing an exponential increase in the use of smart 
phone applications as a source of valid and updated health-care 
related information by the general public and health-care profes- 
sionals. 14 ' 15 Smart phone applications have been studied as a 
source of information for different medical specialties. 4,5,8 ' 13,16 
Paucity of scientific accuracy and clinical relevance of majority 
of apps directed at general users is a growing concern. 7,17 ' 20 Even 
the applications available to the HCAs are not screened for the 
quality and validity of information. 18 ' 20 Our study addresses the 
nature and volume of information about stroke available to us- 
ers, both HCAs and non- HCAs, through iPhone apps and An- 
droid Play Store. In our study we found that there was no statisti- 
cal association between cost of app and scientific validity or use- 
fulness. 

Nearly 90% (43) apps targeting health care professionals 



were scientifically valid where as only 27% (12) targeting gen- 
eral population had the backing of scientific evidence. There 
was statistically significant difference between scientific validity 
of HCAs and non HCAs tool apps further emphasizing the 
need for a central agency which can screen the sensitive health 
care related information being made available to the general 
population. 

Although some of the previous studies on utilization of smart 
phone applications in health care were focused only on Apple 
iTunes, 11 our study did a comprehensive review by including 
both the android Play store and Apple iTunes as our database. A 
limitation of our study was that we analyzed only English lan- 
guage apps and the apps available in other languages were not 
included in the study. Tools formed a considerable proportion of 
the apps for stroke used by health care professional or patients. 
Due to limited number of apps certain variables could not be an- 
alyzed to assess for statistical significance. Since the number of 
users rating the apps varied, there is a potential risk for selection 
bias while assessing usefulness of stroke related apps. There were 
9 apps that were common among Apple iTunes and Android 
Play store, these were included separately since these apps would 
be downloaded and utilized by different users. But analyzing 
these as separate apps may have affected the results pertaining of 
type of information and target audience. 

The smart phone applications are fast becoming the peg of 
information to both the health care providers and the general 
population. There is a huge demand in the society for health- 
care information about debilitating and fatal illnesses like stroke 
and cardiovascular diseases. Information can now be targeted 
and provided right at the fingertips of the patients, care-takers 
and health professionals. It is very important that both valid and 
accurate health-related information is provided in a cost effec- 
tive manner to those seeking it. 

Conclusions 

The lack of specificity and validity of the app content has a 
risk of potentially endangering patient safety. Therefore, there is 
a need to set up regulatory guidelines to improve the quality 
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and validity of information disseminated by the smart phone 
applications. Also, encouraging the involvement of health-care 
agencies in developing apps aimed at healthcare professionals 
and general audience would ensure that valid and relevant in- 
formation reaches the consumers. 
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